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I.  Introduction 


The  design  of  algorithm  plays  an  important  role  in  operations  research 
in  general  and  dynamic  programming  in  particular.  In  most  dynamic  program¬ 
ming  algorithms,  formalism  of  computing,  data  structure  and  complexity 
analysis  does  not  appear.  One  of  the  objectives  of  this  research  is  to 
provide  such  a  formalism. 

The  storage  and  computational  requirements  of  dynamic  programming  algo¬ 
rithms  have  limited  their  practical  uses.  The  storage  and  computational 
demands  can  become  excessive  whenever  the  state  vectors  are  of  dimension  3 
or  more,  or  if  the  number  of  states  grow  exponentially.  Several  schemes 
have  been  proposed  to  reduce  the  dimensionality  in  dynamic  programming. 
However,  practical  use  of  any  algorithm  dictates  an  efficient  implementation 
of  techniques  on  computers.  But  how  efficiently  do  these  algorithms  run 
on  computers  necessitates  their  study  from  the  point  of  view  of  complexity 
analysis,  for  an  algorithm's  performance  profile  is  measured  in  terms  of 
computing  time  and  space  that  are  consumed.  The  asymptotic  complexity  of 
an  algorithm  determines  the  size  of  a  problem  that  can  be  solved  by  the  algo¬ 
rithm.  If  input  has  size  k,  and  for  some  constant  c  the  algorithm  solves 
the  problem  in  ckP  time  or  takes  ckP  storage  spaces,  we  say  that  its 
computational /storage  complexity  is  c(kP). 

In  subsequent  sections,  we  consider  converging  branch,  diverging  branch, 
feed-forward  loop  and  feedback  loop  systems.  In  each  case,  first,  a  high 
level  algorithm  followed  by  the  detailed  computer  algorithm  is  described. 
Formulas  for  storage  and  computational  complexities  for  each  computer 
algorithm  are  derived.  Finally  algorithms  are  implemented  on  VAX-11/780 
computers  using  UCSO  PASCAL. 
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2.  Diverging  Branch  System 
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Consider  the  diverging  branch  system  with  the  following  characteristics. 
The  state  and  decision  variables  are  given  by 

1  1  xil  i.  kil »  1  1  dil  i.  Pi  1  where  1  i  <  m 
1  <  xi  <  ki ,  1  <.  di  1  Pi  where  1  <  i  <  n. 

The  transformations  and  returns  are  described  by  the  following  tables. 


xi-l  =  ti(xi.di),  ri  =  r-j (x-j ,d-j )  where  1  <  i  <n 
xi-l,l  =  tilfxil.dil)*  ril  =  ril(xil»dil)  where  1  <  1  1  m 
xml  =  Tsl(xs»ds) 

Let  k  *  max(kn,...kmi,ki...kn)  and  kj  =  k  +  1. 


2. 1  High-level  Algorithm  for  Diverging  Branch 

First  process  the  branch  including  stages  11  through  ml,  and  store 
the  optimal  return  from  stage  ml.  Process  stages  1  through  s-1  using 
serial  DP-algorithm.  Combine  the  optimal  returns  from  stages  s-1  and 
ml  to  the  return  at  stage  s,  and  optimize  the  resultant  return.  Finally, 
process  the  stages  s+1  through  n  using  serial  DP-algorithm  and  determine 
the  optimal  return  at  stage  n. 


A.  For  the  branch  including  stages  11  through  ml: 


1.  fll(xn)  =  max  rntxu.dn); 

dll 

Store  d*n,the  optimal  decision. 

2.  fil(xu)  =  max(ri1(xii,dil)  +  (tii(xu,du))); 

dil 

Store  d*ii,  the  optimal  decision  for  i  = 

3.  Store  ( xml )  f°r  later  use. 


B.  For  main  branch  including  stages  1  through  s-1: 

1.  f  1  ( X! )  =  max  r^xj.dj); 

dl 

Store  d*i,  the  optimal  decision. 

2.  fi(xi)  =  max(r1(xi,di)  +  f i_i (ti (x, .d, ) ) ) ; 

di 

Store  the  optimal  decision  d-j*  for  2  £  i  <_  s-1. 


C.  For  junction  stage  s: 

fs(xs)  =  max(rs(xs,ds)  +  fs-l (ts(xs.ds) )  +  ^ml (^sl (xs,ds) ) ) i 
ds 

Store  the  optimal  decision  ds*. 

D.  For  the  main  branch  including  stages  s  +  1  through  n: 

f  i  ( x  -j )  =  rnaxtr^xi.d,)  +  f  i-i  (t,  (x,  .d^ ) ) ) ; 
di 

Store  the  optimal  decision  d-j*  for  s  +  1  _<  i  <  n. 

E.  For  the  optimal  return  at  stage  n: 

fn(xn*)  =  max  fn(xn). 
xn 

F.  For  the  optimal  decisions  for  stages  n  through  1: 

For  i  =  1  to  n: 

Find  dj*, 

Xi-1*  a  ti(x1*,di*). 

If  i  =  s  +  1  then  xs=  x*s. 


6.  For  optimal  decisions  for  stages  mj  through  11: 

xml*  =  tsl(xs»^s*) » 

For  i  =  m  down  to  mj: 

Find  d-j i* ; 

xi-l,l  =  til(xii*,d1i*); 

2.2  Diverging  Branch  Computer  Algorithm  (DCBA) 

In  the  above  high-level  algorithm,  a  brute-force  method  would  be 
used  to  store  optimal  decisions  at  each  stage  for  later  retracing  them 
after  the  optimal  return  fn(xn*)  has  been  found.  This  dictates  an 
enormous  amount  of  storage.  Instead,  a  technique  has  been  used,  which 
marks  the  optimal  decision  value,  say,  di*  by  adding  kj  =  1  +  k  to 
the  state  entry  t-j (x-j*,d-j*) ,  where  k  =  max(ku ,. . . kmi ,kj ,. . . kn).  This 
eliminates  the  need  for  the  optimal  decision  storage.  Later  when  the 
optimal  decision  d,-*  is  to  be  retraced,  it  may  be  retrieved  by  searching 
Xi*-row  of  t-j  for  t0(xi*,di*)2kcj  over  values  of  dj.  Any  future  refer¬ 
ence  to  the  table  tj  will  be  made  as  (each  entry)  mod  2k(j. 

In  a  diverging  branch  system,  tables  F(0;1 ,1 :K)  are  needed  for  opti 
mal  return  processing  at  each  stage.  At  each  stage  i  the  optimal  return 
is  processed  by  using  the  previous-stage  optimal  return  from  F(st,.), 
and  stored  in  F(dt,.),  where  st  =  (i-l)mod  2,  and  dt  =  i  mod  2.  The 
optimal  return  fmi  is  stored  in  the  table  FM(1:K).  Note  st  and  dt 
indicate  indices  of  source  and  destination  tables  respectively. 

We  first  explain  the  notations.  The  algorithms  are  described  in  a 
PASCAL-type  construct.  Comments  are  enclosed  within  (*...*).  Enclosure 
of  a  simple  or  a  complex  statement  within  a  loop  is  effected  by  indent¬ 
ing  the  statement.  In  the  following,  the  computer  algorithm  for  the 


diverging  branch  system  is  described. 


A.  (*  Branch  including  stages  11  through  ml  *) 

1.  (*  Initialize  *) 

For  Xu  =  1  to  kjj  do 

F(l,xn)  =  rnfxn.du*)  *  max  rn(xii,dn); 

1  <  dll  <  PU 

tn(xn.dii*)  =  tn(xn,dn*)  +  kj; 

2.  (*  Process  stages  11  through  ml  *) 

For  i  =  2  to  m  do  (*  Find  source  table  *) 

st  =  (i-1)  mod  2;  (*  Find  destination  table  *) 

dt  =  i  mod  2; 

For  Xji  =  1  to  kji  do 

F (dt,  x-n)  =  rix(xii ,  dn*)  +  F(st,ti , (xu ,dn*) ) ; 

*  max  (riiCxii.dii))  +  F(st,tn(xi1,di1))); 
1  <  dil  <  Pi  1 

til(xil»dil*)  *  til(xil»dil*)  +  kdJ  (*  mark  optimal  de¬ 
cision  in  tii  *) 

3.  (*  Move  the  optimal  return  fmi(xmi)  to  the  table  FM(.)  and  free 

F(0t.)  and  F( 1 )  for  further  processing  *) 

For  Xfni  *  1  to  kmi  do 

FMUml)  “  F ( dt , xml ) ; 

B.  (*  stages  1  through  s-1  in  the  main  branch  *) 

1.  (*  Initialize  *) 

For  i  =  1  to  k  do 
F(0,i)  =  0; 


2.  For  i  =  1  to  s-1  do 


St  =  ( 1 -1 )  mod  2; 
dt  =  i  mod  2; 

For  x-j  =1  to  k-j  do 

F(dt,  Xi)  =  r(xi,di*)  +  F(st,t,  (x,  ,d-j  * ) ) 

=  max  ( r-j  (xi  ,d-j )  +  F(st  ,ti  (x-j  »d-j ) ) ) ; 

1  <  d,  <  Pi 

ti(xi,di*)  =  t -j  (x-j  ,di*)  +  kd 

C.  (*  Junction  s  *) 

st  =  (s-1)  mod  2; 
dt  =  s  mod  2; 

For  xs  =  1  to  ks  do 

F(dt,xs)  =  rs(xs,ds*)  +  F(st,ts(xs,ds*) )  +  FM(tsi(xs,ds*)) 

=  max  (rs(xs,ds)  +  F(st,ts(xs,ds) )  +  FM(tsl(xs,ds))); 

1  <  ds  <  ps 

^s(xS»^S*)  =  ts(Xs,ds*)  +  kdi 

D.  (*  Stages  s  +  1  through  n  *) 

For  i  =  s  +  1  to  n  do 
st  =  (i-1)  mod  2; 
dt  =  i  mod  2; 

For  Xi=l  to  ki  do 

F(dt,xi)  =  rf(xi,di*)  +  F(st,tj(xi,di*)) 

=  max(ri(xi,di)  +  F ( st ,t i (xi ,di ) ) ) ; 

1  <  di  <  Pi 

ti(xi’c^i*)  s  ^i(xi«di*)  +  kd; 

E.  (*  Optimal  return  fn(xn*)  *) 

FN(xn*)  =  F(dt,xn*)  *  max  F(dt,xn); 

^  i.  xn  1  ^n 


1. 1  Mii 
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F.  (*  Optimal  decisions,  stages  n  through  1  *) 

For  i=n  down  to  1  do 

select  x*-row  of  tj  and  search  for  t-j  (x-j*,d-j*)  kd  for  1  _<  d^  _<  p-j ; 

If  i=s  then  xs=xs*  and  DS=ds* 
xi-l*  a  ti (xi*»di*)  mod  kd; 

G.  (*  Optimal  decisions,  stages  mj  through  11  *) 

xml*  =  tsi(XS,DS) 

For  i=m  down  to  1  do 

select  x-ji*-row  of  tij  and  search  for  t-fi(x-fi*,d-fi*)  _>  kd  for  1  _<  d-jj  <_  p-,- 
xi-l ,1*  =  tii(x11*,dil*)  mod  kd; 

2.3  Storage  Complexity  of  DBCA 

We  assume  that  each  variable  takes  a  unit  storage  space.  We 
calculate  the  demand  for  the  storage  tables  during  computation.  All 
input  tables  and  variables  created  during  the  processing  are  ignored 
for  this  analysis. 

Theorem:  The  storage  complexity  of  DBCA  is  given  by  3k  or  0(k) 

Proof:  The  tables  needed  by  DBCA  are  F(0:l,l;k)  and  FM(l:k)  which 
consume  2k  and  k  spaces  respectively. 


I 

I 

1 


i <4<im 
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For  the  purposes  of  our  analysis,  we  consider  all  arithmetic 
operations,  assignments,  comparison  and  mod  operations  as  basic  computa¬ 
tional  operations.  Other  complex  operations  such  as  finding  an  optimum 
of  a  list  or  searching  a  list  involves  these  basic  operations.  The 
computational  complexity  of  an  algorithm  is  given  by  the  number  of  basic 
operations  performed. 

As  an  example  consider  a  list  ci,C2,...cji  of  values  where  c, 
is  a  composition  of  q  of  these  basic  operations.  A  simple  routine  to 
find  the  optimum  value  V  will  be: 

V  =  CIS 

o0=  1; 

For  j  =  n  to  1  do 

If  V  £  Cj,  then  J0  =  j;  V  =  Cj 

The  maximum  number  of  the  basic  operations  in  this  routine  is  (qj+3)-l. 

j=l 

Similarly,  searching  a  value  V  in  the  list  can  take  a  maximum  of  1  com¬ 
parisons.  Of  course,  more  efficient  searching  algorithms  are  available. 
However,  for  the  purposes  of  our  analysis  we  choose  this  brute-force 
method  to  get  an  estimate  on  the  worst  cases. 

In  the  following  we  derive  the  formula  for  computational  complexity 
of  DBCA. 

Theorem  2:  The  computational  complexity  of  DBCA  is  given  by 

(4k  i  ip  -f  i  +  kn  +  pu  +  7)  +  (4k  7-pi  +  k,  +  Pj  +  10) 

i=l  i=l 

+  ksPs  -  kllPll  +  3kn  +  k„,i  +  k  -  5 

Proof :  We  list  below  the  number  of  basic  computations  performed 


at  each  step  of  DBCA. 


Step  Number  of  Basic  Computations 

A-l  3kllPll  +  kn 

m 

A-2  (4ki lPi 1  +  kil  +  5) 

i=2 

A-3  kmj 

B-l  k 

s-1 

B-2  (4k  -j  Pi  +  ki  +  5) 

i=l 

C  5(ksPs  +  ks  +  5) 

n 

D  (4kjpj  +  k-j  +  5) 

i=s+l 

E  3kn  -  1 

F  (Pi  +  5) 

1=1 

m 

G  (pn  +  2)  +  1 

1=1 

The  addition  of  these  values  gives  the  result  of  the  theorem. 

Corollary  1:  Suppose  that  all  discretization  levels  equal  k,  in  other 
words,  kji  =  p-j i  =  k,  =  pi  =  k,  for  all  admissable  values  of  i.  Then 
the  computational  complexity  of  DBCA  is  given  by: 

2(m^  +  n^  +  m  +  n)k2  +  (m2  +  n2  +  m+  n  +  5)k 
+1/2 (7 +  9n^  +  7m  +  9n  -  10) 

Corollary  2:  the  DBCA  has  computational  complexities  of  O(k^),  O(rn^), 
and  0(n2)  where  k  is  the  level  of  discretization  of  state  and  decision 
variables  and  m,  n  are  numbers  of  stages  in  the  diverging  and  main 
branches  respect i vely. 


Corollary  3:  Let  all  three  subbranches  in  the  diverging  branch  system 
be  approximately  equal,  i.e. ,  S  =  N/2  =  M,  Then  the  complexity  formula 
reduces  to  2(5m2  +  3m)k^  +  (5m^  +  3m  +  5)k  +  l/2(43m2  +  25m  -  10). 


Corollary  4:  The  computational  complexity  of  DBCA  is  independent  of 
the  stage  from  where  the  diverging  branch  starts. 

Proof:  The  formula  for  the  complexity  in  theorem  2  does  not  contain 
the  junction  point  s. 


3.  Converging  Branch  System 
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The  state  and  decision  variables  are  given  by: 

1  i.  xi  <.  ki ,  1  _<  d-j  _<  p-j  where  1  <  i  <  m 
1  i.  xii  _<  kji,  1  <_  dji  _<  where  1  <  i  <  m 

The  transformation  and  return  tables  are  given  by: 

Xji  =  tj [xj  ,dj ) ,  r^  »  r^ (xj .d^ )  where  i  <  i  <  n 

Xi-1,1  =  f  i l(xil  »dii )  ,r-j  =  i (xi i  ,di x )  where  1  <  i  <  m,  i^s 

xs-l  *  ts(xs,xoi,ds),rs  =  rs(xs,xoi,ds) 

k  a  max (k^i  j* •  •  k ^  j*  •  •  k^  • » kn)  and  k^|  —  k  ^  1 

3. 1  High-level  Algorithm  For  Converging  Branch  System 

We  describe  a  high-level  algorithm  to  process  the  converging  branch 
network.  First,  the  branch  is  processed  using  initial-final  state 
optimization  of  dynamic  programming  to  obtain  fml(xml*xml)>  ar,d  this 
return  is  optimized  over  xmi  such  that  1  £  xmj  £  k0i.  The  optimal 
return  is  stored  for  later  use.  Stages  1  through  s-1  of  the  main  branch 
are  processed  using  serial  DP  algorithm.  The  return  at  junction  s  and 
the  optimal  returns  from  s-1  and  the  branch  are  combined  and  then 
optimized  over  values  of  xqi  and  decision  variable.  Stages  s+1  through 
n  of  the  main  branch  are  processed  using  serial  DP  algorithm.  Finally, 


ds  di 

TsT  xs_i  ..xi  ITT 
rs  n 


the  optimal  return  fn(xn*)  ’s  f°und  by  optimizing  fn(xn)  over  values  of 
xn.  In  the  following,  we  present  the  details. 


A.  Initial-final  state  optimization  of  the  branch 

1.  11  (xll »x01 )  =  max  ni(xll.dii):tii(xii,dn)-  xqi  ; 

2.  For  2  i  £  m, 

fil(xil»x0l)  =  maxCruUu.dii)  +  “Fi-i ,  l  (ti„i  (x^  i  ,d-n )  .xqi  ) )  s 
1  <  dil  <  Pi  1 

B.  Process  the  optimal  return  at  stage  mj 

fml(x0l)  =  n»x(fml(xmi,xoi)), 

1  i.  xml  i.  kml 

Store  fmi ( xqi ) ; 

C.  Process  stages  1  through  s-1 

1.  foUo)  =  0. 

2.  f i  ( x -j )  =  maxCr^x,  ,di)  +  f i-i (t,  (x,  ,di ) ) ,  1  <  i  <  s-1; 

1  <  di  <  Pi 

Store  di*  which  optimizes  the  return. 

D.  Process  junction  s: 

fs(xs)  =  max(rs(xs,x0i,ds)  +  fs_i(ts(xs,ds)  +  fmi(xo)) 

1  <  ds  <  ps 
1  <  X01  <  k01 

Store  ds*  and  xqi*  which  optimize  the  return. 

E.  Process  stages  s  +  1  through  n: 

1.  For  s  +  1  i  n, 

f i ( x i )  =  max(ri(xi,di)  +  f i_i (ti (x, ,di ) ) ) ; 

1  £  di  <  Pi 

Store  di*  which  optimizes  fi. 


( 


F.  Optimal  return  fn{xn*)  at  stage  n: 

=  fn(*n) 

1  1  xn  < 

G.  Optimal  decisions  for  stages  n  through  1: 

1.  For  i=n  down  to  s+1; 

Find  d^*; 

xi-l*  =  ti (xi*,di*); 

2.  At  junction  s: 

Find  ds*; 

xs-l*  =  ts(xs*,xoi*,ds*); 

3.  For  i  =  s-1  down  to  1: 

Find  di*; 

xi-l*  =  ti(xi*,di*); 

H.  Optimal  decisions  for  stages  11  through  mj  of  the  branch: 

fll(*ll)  *  max(r1i(xii,dii):(tli(xn,dii)  *  x0i *) ; 

1  1  dll  i  Pll 

2.  For  2  j<  i  _<  m: 

fil(*il)  =  max{r1i(xii>d^i)  +  fi-i,i(tn(xil>dii))); 

1  <  di  <  Pi 

Store  d-Q*; 

3.  Find  max  (fmi(xml)); 

1  i.  xml  S.  ^ml 

Let  xm]*  optimize  fmy, 

4.  For  i  =  m  down  to  1: 

Find  dii*; 

xi-l,l  =  til(xil*>dil*)v 


J3E. 


3.2  Converging  Branch  Computing  Algorithm  (CBCA) 


We  follow  the  notations  of  section  2.1,  for  processing  converging 
branch  system,  tables  Fl(0:l,l:k,l:k)  and  F(0:l,l:k)  are  needed  to  store 
converging  branch  and  main  branch  optimal  returns.  A  table  FM ( 1 : k )  is 
needed  to  store  the  optimal  return  at  the  stage  ml  for  later  use.  Now, 
we  describe  the  CBCA  in  detail. 

A.  (*  stages  11  through  ml  *) 

1.  (*  Initialize  the  table  FI (1 ,. ,. )  by  processing  stage  11  *) 

For  xji  =  1  to  kji  do 

For  xqi  =  1  to  kQi  do 

FI  (l,xn  ,xqi  )  =  rn(xii,dn*)  =  max(r11(x11,d11)| 

tll(xil.dll)  =  *oi ) '» 

2.  (*  Process  stages  21  through  ml,  using  tables  FI (0 ,. ,. ) 
and  FI (1 ,.  ,.}*) 

For  i=2  to  m  do 

st  =  (M)mod  2; 
dt  =  i  mod  2; 

For  x-Q  =  1  to  k  i i  do 

For  XQi  =  1  to  kgi  do 

Fl(dt,xii,x0i)  =  nxCxii.dix)  +  Fl(st,til(xil,di1),x0i)i 

B.  (*  Maximize  fml (%1  .^oi )  over  values  of  xmi,  and  store  the 

I 

optimal  values  in  table  FM(. )  *) 
st  =  m  mod  2; 

For  xoi  s  1  to  koi  do 

FM(xoi)  =  F1(st,xml,xoi)  =  max  Fl(st,xml,xoi); 

1  i.  xml  S  ^ml 


C.  (*  stages  1  through  s-1  *) 

1.  (  *  Initialize  by  putting  0's  in  the  source  table  *) 

For  i=l  to  k  do 
F(0,i)  =  0; 

2.  For  i=l  to  s-1  do 

st  =  ( i - 1 )  mod  2; 
dt  =  i  mod  2; 

For  Xj=l  to  kj  do 

F(dt.xi)  =  ri(xi,dj*)  +  F(st,ti (xj .d,*) ) 

=  max(rj  (x-j  ,di )  +  F(st,tj (xj .d, ) ) ) ; 

1  £  di  <  Pi 

ti(xj,di*)  =  t-j  (x-f  ,dj*)  +  kd; 

D.  (*  At  junction  there  are  two  source  tables,  FM(.)  and  F(st,.)  *) 

st  =  (s-1)  mod  2; 
dt  =  s  mod  2; 

For  xs=l  to  ks  do 

F(dt,xs)  =  rs(xs,x0i*,ds*)  +  F(st,ts(xs,x0i*,ds*) ) 

+  FM(xqi)); 

=  max(rs(xs,x0i*,ds)  + 

1  £  ds  £  Ps 

F(st,ts(xs,x01*,ds*)  =  ts(xs,x0i*,ds*)  +  k< 

E.  (*  stages  s+1  through  n  *) 

For  i  =  s+1  to  n  do 
st  =  (i-1)  mod  2; 
dt  =  i  mod  2; 

For  x i =1  to  ki  do 

F(dt,x1)  =  ri(xi,di)  +  Ffst.t1 (xt ,dt*) 

=  max(ri(xi,di)  +  F(st,ti (x, ,d^ ) ) ; 

1  £  di  £  Pi 

ti (xi .di*)  =  ti(xi,di*)  +  kd; 


F.  (*  Find  optimal  return  fn(xn*)  *) 

Fn(xn*)  =  F(st,xn*)  =  max  F(st,xn); 

1 1  xn  m 

G.  (*  Optimal  decisions,  stages  n  through  1  *) 

1.  For  i=n  down  to  s+1  do 

Search  Xj*-row  of  ti  for  ti(xi*,di*)  >*d  for 

1  _<  di  p-j ; 

Xi_i*  =  ti(x,*,di*)  mod  kd; 

2.  Search  xs*xoi*-row  of  ts  for  ts(xs*,xoi*,ds*)  £  kd, 
1  S.  Ps* 

xs-i*  =  ts(xs*,xoi*,ds*)  mod  k<j; 


3.  For  i  =  s-1  down  to  1  do 

Search  x-j*-row  for  ti(xi*,di*)  kd,  1  <.  di  <.  Pi ; 
Xi>i*  =  ti(xi*,di*)  mod  kd; 


H.  (*' Optimal  decisions,  stages  11  through  mj  *) 

1.  For  x i i=l  to  kjj  do 

F1(1,xii,xqi*)  =  i"l(xn,dn*)  =  max(ri(xii,dn)| 

1  <  dll  <.  Pil 

tll(xll »dll*>  *  tllUll.dll*)  +  kd 

2.  For  i=2  to  m  do 

st  »  (i-1)  mod  2; 
dt  =  i  mod  2; 

For  Xii=l  to  k -j i  do 

Fl(dt,Xii  ,xqi*)  =  ri  i  (xi  i  ,dii*)  +  Fl(st,tii(xii,dii*)xo 

=  max(rll(xii,dix*)  +  Fl(st,ti (xii,dii)xoi*) ) ; 

1  <  du  <  PH 

til(*il>dil*)  *  ^i 1 (xi 1 »dil*)  +  kdi 


3.  st  =  m  mod  2; 


I 

I 

I 

■ 

4k 


FI (st.Xfni*,^!*)  =  maxFl(st,  xmi,x0i*); 

1  i.  xml  £.  ^ml 

4.  For  i=m  down  to  1  do 

Search  Xii*-row  of  t^  for  tii(xii*,dji*)  >. 

1  £  dil*»  <  Pi  1  * 

*i-l*,l  =  tii(xii*,dii*)mod  kj; 

3.3  Storage  Complexity  of  CBCA 

Here  we  use  the  same  notations  and  techniques  as  in  section  2. 

Theorem  3:  The  storage  complexity  of  CBCA  is  given  by  2k^  +  k  or  0(k2). 
Proof:  The  storage  tables  used  are  F1(0:1,1:K,1:K),  F(0:1,1:K) 
and  FM(1:K).  However,  when  optimal  returns  from  the  branch 
have  been  transferred  to  FM,  FI  can  be  released  and  the 
smaller  table  F  may  be  used.  So  at  any  one  time  the 
maximum  storage  used  will  be  no  more  than  2k?  +  k. 

3.4  Computational  Complexity  of  CBCA 

The  notations  and  techinques  of  section  2  are  used  here  also. 

Theorem  4:  The  computational  complexity  of  CBCA  is  given  by 
m 

(4k iikoiPii  +  4k -j i pi i  -  k i i k0 1  +  k^  +  pn  +  12 
i-1 

n 

+  (4ki Pi  +  ki  +  Pi  +  7)  +  5kskgips  +  3kmlk0i  -  4ksps  -  k0i 
i=l 

+  3kn  +  3kmi  +  k  -  8 

Proof:  The  number  of  computations  performed  at  each  step  of  CBCA 
is  listed  below: 


1 


I 


Step 
A.  1 


A.  2 


B 


C.l 


C.  2 


D 

E 

F 


G.l 


G.  2 


G.3 


H.  1 


H.2 


H.  3 


H.  4 


Number  of  Basic  Operations 

4kilk01Pil  -  kilk01 
m 

(4kiik0iPii  -  Mikoi  +  5) 
i=2 

3kmlk01  -  k01  +  2 
k 

s-1 

(4k  i  p-j  +  k-j  +  5) 
i=l 

5kskoiPs  +  ks  +  5 
n 

(4kipi  +  k-j  +  5) 

i=s+l 


(Pil  +  2) 

i=s+l 
pS  +  2 
s-1 

(Pi  +  2) 
i=l 

4knpu  +  kxl 
m 

(4kjipji  +  kn  +  5) 
i=2 

3kmi  +  1 
m 

( Pi i  +  2) 
i=l 


Addition  of  these  results  gives  the  complexity  stated  in  the  theorem. 


Corollary  5:  Let  =  p-ji  =  k,  =  Pi  =k  for  all  admissible  values  f-j. 
Then  the  computational  complexity  formula  for  CBCA  reduces  to 

(2m^  +  2m  +  5)k^  +  l/2(m2  +  4n^  +  m  +  4n  -  2)k^  +  (m2  +  n2  +  m  +  n  +  6 ) k 
+  l/2(12m2  +  7n2  +  i2m  +  7n  -  16) 

Corollary  6:  For  the  conditions  stated  in  Corollary  5,  the  CBCA  has 
complexities  0(k3) ,0(m2) ,0(n2). 

Corollary  7:  Assuming  that  the  numbers  of  stages  in  the  three  subbranch¬ 
es  of  the  converging  branch  network  are  approximately  equal  (s=n/2=m), 
the  formula  for  the  complexity  reduces  to 

(2m^  +  2m  +  5)k^  +  l/2(m2  +  4n  +  m  +  4n  -  2)k^  +  (5m2  +  3m  +  6)k 

+  (20m2  +  13m  -  8) 

Corollary  8:  The  computational  complexity  of  CBCA  is  independent  of 
the  junction  stage. 

Proof:  The  result  of  theorem  5  does  not  contain  any  s. 


4.  Feedforward  Loop  System 


Xml  JjQil  xm-l  ,1  X11  HU  xoi 


n  1  n  1  xn-l 


<j  1  J  I  xj-l  xs_2  1  s-1 1  XS_1  M  xs-l  xp  nr 


The  state  and  decision  variables  are  given  by 
1  <  xi  <  ki,  1  £  £  Pi  where  1  >_  i  _<  n; 

1  1  xil  1  kil»  1  £  dil  £  Pi l  where  1  £  i  £  m; 

k  —  ma  x  ( k  ^  ^ •  k  ,  •  •  • ,  k  ^  ,  k  p ) ,  kj  *  k  ^  1 

Transformations  and  returns  are  described  by  tables 

xml  a  tji(xj.dj); 

xi-1,1  ■  tii(xii.dii),  1  £  i  £  m; 
xs-l  =  Ts(xs,xqi  »^s)  '* 
xi-l  =  ti(xi,di),  1  <  i  <n,  i^s; 
rs  =  rs(xs,xoi,ds); 

H  =  r-j(x-j , d-j ) ,  1  £  i  £  n,  i7s; 
ril  =  ri  1  (xi  1  »di  1 ) »  1  £  1  £  m- 

4. 1  High-level  Algorithm  for  Feedforward  Loop  System 

First,  the  loop-branch  is  processed  as  an  initial-final  state 
optimization  using  serial  DP-algorithm,  and  the  optimal  return 
fmi(xml»x0l)  is  stored.  Similarly,  using  serial  DP-algorithm  stages 
1  through  s-1  are  processed  and  fs-i(xs_i)  is  stored.  Stages  s  through 
j-1  are  processed  obtaining  returns  which  depend  on  xqi*  The  branch 


optimal  return  and  that  from  the  stage  j-1  are  combined  with  the  return 
at  j*th  stage,  and  the  resultant  return  is  optimized  over  values  of 
x0i  and  dj.  Stages  j+1  through  n  are  handled  using  serial  DP-algorithm, 
and  optimal  return  fn(xn*)  is  determined. 

The  details  of  this  algorithm  are  given  below: 

A.  For  branch  including  stages  11  through  mi,  perform  initial-final 
state  optimization. 

1*  fll(xil,x01)  =  maxfrnfxn.duhtnfxu.dn)  =  x01); 
dll 

2-  fil(xil.xoi)  =  max(ril(x11,dil)  +  fi_i (ti i (x, x ,di X ) , xqi ) ) , 
dil 

2  <  i  <  m; 

Store  fmi(xmi,xoi); 

B.  Serial  DP-algorithm  for  stages  1  through  s-1: 

1.  fo(xg)  «  o  (*  initialize  *) 

2.  f  i  (x-j )  =  max(ri  (x-j , d-j )  +  f  j_i  (t-,-  (x,  ,di ) ) 

di 

Store  optimal  decision  d-j*  which  optimizes  f-j. 

3.  Store  f$_i(xs_i). 

C.  At  the  stage  s  perform  usual  DP  optimization. 

fs(xs.xoi)  =  max(rs(xs,x0i,ds)  +  fs_i(ts(xs,x0i,ds) ) ) ; 
ds 

D.  Stages  s+1  through  j-1: 

f  i  (xi  ,xqi  )  =  maxCnfxj.dj)  +  fi_i  (t,  (x,  ,di )  ,x0i )) ; 
di 

E.  At  j  combine  all  returns: 

fj(xj)  =  max(rf(xj,dj)  +  fj-i(tj(xj,dj),xoi)  +  fml(tji(xj,dj),xoi)); 
xoi.dj  . 

Store  the  optimal  decision  dj*  and  xgi*. 


Stages  j+1  through  n: 


fj(xi)  =  max{ri(xj,di)  +  ff_i (t, (x, ,d, ) ) ; 
di 

Store  the  optimal  decision  d-j*. 

fn(xn*)  =  max  ^n(xn) 
xn 

Optimal  decision  stages  n  through  1: 

1.  fs(xs)  =  max{rs{xs,x01*,ds)  +  fs-l(ts(xs,x0i*,ds))) ; 

ds 

Store  the  optimal  return  at  ds*. 

2.  For  s+1  _<  i  j-1: 

f i  (xi )  =  max{r^  ( x-j  ,d, )  +  f i_i  (t-j  (x-j  .d, ) ) ) ; 
di 

Store  d,*. 

3.  For  i=n  down  to  s+1: 

Find  d-j*, 

xi-l*  =  ^i (xi*>di*) » 

If  i=j  then  XJ=xj*. 

4.  Find  ds*; 

xs-l*  =  tsCxs^.xoi*.^*); 

5.  For  i=s  down  to  1: 

Find  dj*; 

xi-l*  =  f i (xi*»di*) * 

Optimal  decision  for  stages  11  through  mj: 

!•  fll(xll)  =  n’ax(rn(xll>dll):tll(xll,dll)  =  xqi*); 

dll 


2.  For  2  <  i  <  m: 


I 


f i  1  ( x i  1 )  =  max(rii(xii,dii)  +  fj-iUji  (xix.dn))); 

Store  optimal  decision  d^*; 

=  t  j-j  (XJ  ,dj*) ; 

4.  For  i=m  down  to  1: 

Find  d ^ j * ; 

xi-l*,l  =  til(xil*>dil*)i 

4.2  Feedforward  Loop  Computer  Algorithm  (FFLCA) 

In  FFLCA,  tables  F1(Q:1,1:K,1:K )  and  F(0:1,1:K)  are  needed  for 
storing  optimal  returns.  Moreover,  FS(1:K)  and  FM(1:K,1:K)  are  also 
used  for  storage  of  fs-l(xs_i)  and  fml(xml*x0l)  for  further  processing. 

A.  (*  Branch  stages  11  through  mj  *) 

1.  (*  Initialize  Fl(l,.,.)  by  processing  stage  11  *) 

For  xx i=l  to  Iqi  do 

For  xqi  to  kgi  do 

Fl(l,xn,xoi)  =  rilUii.dii*)  =  max(rii(xn,dii)l 

1  <  dll  <  Pll 

tll(xll»dll)  =  *oi); 

2.  For  i=2  to  m  do 

st  =  (i-1)  mod  2; 
dt  =  i  mod  2; 

For  Xji=l  to  k-j ,  do 

For  xqi=1  to  kgi  do 

Fl(dt,xii,x0i)  B  ni(xii,dii*)  +  Fl(st,tii,(xii,dii*),xo); 

=  maxfr^fx^.dij)  +  FI  ( st ,  t  f  j  ( x7- j ,  d,  2  *)»  xq  )) ; 
1  <  dil  <  Pi  1 


t 


3.  (*  Store  the  mth  stage  results  into  FM(.,.)  for  later  use  *) 

For  xml=l  to  kmi  do 

For  xqi=1  to  kgi  do 

FM(xml,xoi)  =  Fl(dt,Xji,xoi); 

B.  (*  Stage  1  through  s-1  *) 

1.  (*  Initialize  by  putting  0's  in  the  source  table  *) 

For  i=l  to  k  do 
F(0,i)  =  0; 

2.  For  i=l  to  s-1  do 

st  =  (i-1)  mod  2; 
dt  =  i  mod  2; 

For  xi=l  to  ki  do 

F(dt,Xi)  =  r-j (xi  ,d-i*)  +  F(st,tj  (x-j  .d,*) ) 

=  maxCr^Xi.di)  +  F(st  .t,-  (x,  ,d-j ) ) ; 

1  <.  di  <  Pi 

ti(xi»di*)  =  t-j  (x-j  ,d-j*)  +  kd; 

3.  For  xs_j=l  to  ks_i  do 

FS(xs-l)  =  Fjdt.Xs.i); 

C.  (*  stage  s  *) 

St  =  (s-1)  mpd  2; 
dt  =  s  mod  2; 

For  xs=l  to  ks  do 

For  xgi=l  to  kgi  do 

Fl(dt,xs,x0i)  =  rs(xs,x0i,ds*)  +  FS(ts(xs,x0i,ds*)) 

=  max(rs(xs,X0j,ds)  +  FS(ts(xs,x0i,ds*)); 
1  <  ds  <  ps 


D.  (*  Stages  s+1  through  j-1  *) 
For  i=  s+1  to  j-1  do 


st  =  (i-1)  mod  2; 
dt  =  i  mod  2 ; 

For  x-j=l  to  k-j  do 

For  xqi=1  to  kgi  do 

Fl(dt.Xi.xoi)  =  n(xi,di*)  +  Fl(st,ti(xi,di*) 

=  max(r-i(xi  ,di)  +  Fl(st,t-j  (x-j  .d^ 
1  £  dj  <  Pi 


E.  (*  Stage  j  *) 

st  =  (j-1)  mod  2; 
dt  =  j  mod  2; 

For  xj=l  to  kj  do 

F ( dt , x j )  =  rj(xj,dj*)  +  FI (st.tj (xj ,dj*) ,xqi*) 

+  FM(tj-j(xj,dj),X0i)); 

=  max(ri(xj,dj*)  +  Fl(st,tj(xj,dj) ,xoi)  + 
1  <  xoi  1  k0i 

1  <  dj  <  Pj 

tj(xj»dj*)  =  tj(xj,dj*)  +  kd;  tji(xj,dj*)  =  tji(xj 

F.  (*  Stages  j+1  through  n  *) 

For  i=j+l  to  n  do 

st  =  (i-1)  mod  2; 
dt  =  i  mod  2; 

For  xi=l  to  k,  do 

F(dt.x-j)  =  r^Xj.dj*)  +  F(st,ti  (x-j  ,d^*)) 

=  max(rj (xi ,dj )  +  F(st,tj (x, fd, ) ) 

1  <  di  <  Pi 

ti(xi,di*)  =  ti(xi,di*)  +  kd 


,*Ol) 

),xoi))i 

FM(tji(xj,dj),xo 

»dj*)  +  kd; 


G.  (*  Find  maximal  return  f n (xn*)  *) 

Fn  =  F(dt,xn*)  =  max  F(dt,xn); 

^  1  xn  1  ''n 

H.  {*  Optimal  decisions  for  stages  n  through  1  *) 

1.  dt  =  s  mod  2; 

For  xs=l  to  ks  do 

Ffdt.Xs.XQ!*)  =  rs(xs,x0i*,ds*)  +  FS(ts(xs ,xoi*»ds*) ) 

*  max{rs(xs,X0i*,ds)  +  FS(ts(xs,x0i*,ds))); 

1  <  ds  <  ps 

Mxs»x01*»ds*)  =  ts(xs,x0i*,ds*)  +  kd 

2.  For  i  =  s+1  to  j-1  do 

st  =  (i-1)  mod  2; 
dt  =  i  mod  2; 

For  Xi=l  to  k-j  do 

Fl(dt,Xi  .xq!*)  =  r-j  (x-j  ,di*)  +  FI (st.ti  (x,  .d,*)  ,xoi*) 

■  max(ri  (x,  ,d-j )  +  F(st,ti (xi ,di ) ,x0i*)) ; 

1  £  di  <  Pi 

"t i  (xi  ,di*)  =  t-j  (x-j  ,di*)  +  kd; 

3.  For  i=n  down  to  s+1  do 

Search  Xi*-row  of  ti  for  t-j  (x-j ♦.d-j *)  kd,  1  <.  d,  £  p-j ; 
If  i=j,  then  xj=Xj*; 

Xi-i*  =  ti(xi*,di*)  mod  kd; 

4.  Search  xs*-row  of  ts  for  ts(xs*,XQi*,ds*)  >_  kd,  1  £  ds  <  ps; 

xs-l*  =  mod  kdi 

5.  For  i  =  s-1  down  to  1  do 

Search  xi-row  of  ti  for  ti(xi*,d,*)  >.  kd,  1  <  d7-  _<  p, ; 
xi-l*  ■  ti(xi*,di*)  mod  kd; 


■  gNggiwto  ii  j 


I.  (*  Optimal  decisions  for  stages  11  through  *) 

1.  For  xi i=l  to  kn  do 

Fl(l,xn,xoi*)  =  rufxu.du*)  =  max(rn(xn  ,dn )  |ti  i  (xi  i  ,dn  )=xoi*) ; 

1  £  dll  £  Pll 

tn(xn»dii*)  =  tnUn.dn*)  +  kd; 

2.  For  i=2  to  m  do 

st  =  (i-1)  mod  2; 
dt  =  i  mod  2; 

For  Xi i=l  to  k -j i  do 

Fl(dt,Xii ,xqi*)  =  r*i i (x-j i »d-j i*)  +  Fl(st ,ti i (xii  ,dii*)  ,xoi*) 

=  max(rii(xii,dii)  +  FI (st,tji(xji ,dii ) ,xqi*) ) ; 

1  £  dil  £  Pil 

til(xil»dil*>  =  ti(xil>dil*)  +  kdJ 

3.  Search  xj-row  of  tji  for  tji(xj,dj*)  kd,  1  £  dj  £  Pji 

Xml*  *  tji(xj,dj*)  mod  kd; 

4.  For  i=m  down  to  1  do 

Search  Xii*-row  of  t , i  for  t i i  (xii*,dii*)  _>  kd,  1  £  dii  £  Pi i ; 
xi-l,l*  =  tii(xii*,dii*)  mod  kd; 

4. 2  Storage  Complexity  of  FFLCA 

We  use  the  same  notations  and  techniques  as  in  section  2. 

Theorem  5:  The  storage  complexity  of  FFLCA  is  given  by  2k2  +  2k  or 
0(k2). 

Proof:  Two  tables  Fl(0,l:k,l:k)  each  with  k2  storage  requirement  are 
used  to  process  branch.  One  of  these  tables  is  retained  to 
store  fml(xml*x0l)  for  use  while  the  space  taken  by  the 

other  can  be  released.  Tables  F(0:lfl:k)  using  2k  spaces  are 
used  to  process  main  branch.  Moreover,  FS( 1 : k )  and  FM(l:k,l:k) 
are  used  for  storage  of  optimal  returns  for  later  use.  Hence, 


-2C- 


at  one  time  no  more  than  2k2  +  2k2  spaces  are  required 


4.3  Computational  Complexity  of  FFLCA 


The  notations  and  techniques  of  section  2  are  also  used  here. 
Theorem  6:  The  computational  complexity  of  FFLCA  is  given  by 

m  j 

(4k i ikoiPi  1  +  4k i 1 P i 1  "  kilk01  +  kil  +  Pi 1  +  12)  (4kik01  ’  kik01  +  5) 

i=l  i=s 

n 

(4k-jPj  +  k,  +  Pi  +  7)  +  2k; 
i=l 

+  kjk01pj  +  kjk01  -  4k j p j  +  kmlkQ1  +  3kn  +  k$  +  pj  +  k  +  (n2  -  s2  +  n  -  s  - 


Proof:  The  number  of  computations 

Step 
A.  1 

A.  2 

A.  3 

B. l 

B.  2 

B.  3 
C 

0 

E 

F 

G 

H.1 


performed  at  each  step  is  listed  below. 


Number  of  Computations 

4kllk01Pll  "  kllk01 
m 

(4kilk0lPil  -  kilk01  +  5) 

1=2 

kmlk01 

k 

s-1 

(4k i Pi  +  ki  +  5) 
i=l 

ks-l 

4ksk0lPs  *  ksk01  +  5 
j-1 

(4kik01Pi  -  kik01  +  5) 

i=s+l 

5kjk0lPj  +  3kj  +  5 
n 

(4kiPi  +  ki  +  5) 

1-j+l 
3kn  -  1 

4ksps  +  k$  +  2 


j-1 


H.  2 

(4k  -j  Pi  + 

i=s+l 

ki  +  5) 

H.  3 

(Pi  +  4) 

i=s+l 

H.4 

Ps  +  2 

H.  5 

s-1 

(Pi  +  2) 
i=l 

1.1 

4knpn  +  kn 

1.2 

m 

(4k i lPi 1  + 

1=2 

k i i  +  5) 

1.3 

Pj  +  2 

1.4 

m 

(Pil  +  2) 

1-1 


Addition  of  all  these  gives  the  result  of  the  theorem. 


Corollary  8:  Suppose  that  «  pn  =  k,  =  p,  =  k  for  all  admissible 
values  of  i.  Then  the  formula  for  computational  complexity  for  FFLCA 
reduces  to 

2(m2  +  j2  -  s2  +  m  +  j  +  s  +  1/2 )k^  +  l/2(3m2  +  4n2  +  s2  -  j2  +  3m  +  4n  -  j  -  s  - 
+  (m2  +  n2  +  m  +  n  +  8)k  +  l/2(12m 2  +  n2  +  sj2  -  6s2  +  5j  +  4s  +  n  +  12m  -  34) 
In  other  words  it  has  representations  0(m2) ,  0(j2-s2),  0(n2),  and  0(k3). 


Corollary  9:  Assume  that  all  three  subbranches  in  feedforward  loop 
system  are  approximately  equal  ,  i.e. ,  s  =  j/2  =  n/3  =  m.  The  formula 
for  computational  complexity  for  FFLCA  becomes: 

(8m2  +  8m  +  l)k3  +  2(9m2  +  3m  -l)k2  +  2(5m2  +  2m  +  4)k  +  l/2(35m2  +  29m  -  34). 


Corollary  10:  The  computational  complexity  of  FFLCA  depends  on  the 
junction  points  j  and  s  with  complexity  described  as  0(j2-s2). 


H.2 

j-1 

(4k-j  Pi  +  k,  +  5) 

i=s+l 

H.3 

n 

(Pi  +  4) 

i=s+l 

H.  4 

Ps  +  2 

H.  5 

s-1 

(Pi  +  2) 
i=l 

1.1 

4k  1 1P1 1  +  kn 

1.2 

(4k i IP i l  +  kil  +  5) 
i=2 

1.3 

Pj  +  2 

1.4 

m 

(Pil  +  2) 
i=l 

Addition  of  all  these  gives  the  result  of  the  theorem. 

Corollary  8:  Suppose  that  kn  =  pu  -  k,  ■  Pi  *  k  for  all  admissible 
values  of  i.  Then  the  formula  for  computational  complexity  for  FFLCA 
reduces  to 

2(m2  +  j2-s2  +  m  +  j  +  s  +  l/2)k3  +  l/2(3m2  +  4n2  +  s2  -  j2  +  3m  +  4n  -  j  -  s  -  4 
+  (m2  +  n2  +  m  +  n  +  8)k  +  l/2(12m2  +  n2  +  sj2  -  6s2  +  5j  +  4s  +  n  +  12m  -  34) 
In  other  words  it  has  representations  0(m2),  0(j2-s2),  0(n2),  and  0(k3). 

Corollary  9:  Assume  that  all  three  subt?ranches  in  feedforward  loop 
system  are  approximately  equal  ,  i.e. ,  s  =  j/2  =  n/3  =  m.  The  formula 
for  computational  complexity  for  FFLCA  becomes: 

(8m2  +  8m  +  l)k3  +  2(9m2  +  3m  -l)k2  +  2(5m2  +  2m  +  4)k  +  1/2 (35m2  +  29m  -  34). 


Corollary  10:  The  computational  complexity  of  FFLCA  depends  on  the 
junction  points  j  and  s  with  complexity  described  as  0(j2-s2). 


5.  Feedback  Loop  System 


dml 

xm-,l  SE  xml 
rml 


dll 

X01  I  H  1  X11 
11 

dn  dj  ds  di 

xn  M  xn-l  xj  M  xj-l  xs  IH  xs-l  X1  HE  x0 

rn  1  1  1 

The  state  and  decision  variables  are  given  by: 

1  i.  xi  1  ki »  1  1  di  1  Pi  1  <.  i  <.  n; 

1  i.  xil  i.  kil»  *  .1  dil  1  Pi  1  1  1  i  1  1 

k  “  max  kii,...k jk^ •  *kp  and  k^|  ~  k  ^  1  j 

The  states  and  returns  are  given  by  the  tables: 
xj-l  =  tj  (XJ  »dj)  i  1  *  rj  (Xj  ,xqi  ,dj ) ; 
xi-l  =  ti(xi.di);  r,  =  ri(xi,dj)t  1  <  i  <  n,  i#j. 
xml  =  tsl(xs»ds) > 

xi-l,l  =  tii(xii,d11);  r -j i  =  ni(xii,dii)f  1  <  i  <  m. 


5.1  High-Level  Feedback  Loop  Algorithm 


Process  the  branch  including  stages  11  through  m^  using  initial- 
final  state  DP-algorithm,  and  store  the  optimal  return  fml(xml*x0l)  f°r 
later  use.  Process  stages  1  through  s-1  using  serial  DP-algorithm,  and 
combine  this  and  the  branch  optimal  returns  with  the  return  at  the  stage 
s.  Optimize  the  result  over  values  of  ds  to  obtain  fs(xs,xgi).  Process 
stages  s+1  through  j-1  using  serial  DP-algorithm.  After  combining  the 


optimal  return  from  the  stage  j-1  and  the  return  at  j,  optimize  the  result 
over  values  of  xqi  and  dj  to  obtain  fj(xj).  Process  stages  j+1  through  n 
using  serial  DP-algorithm  and  find  the  optimal  return  by  optimizing  fn(xn) 
over  values  of  xn. 

A.  Stages  11  through  mi 

1*  fllUn.xoi)  =  max  rii(xn,dii)|tii(xii,dii)  =  xoi  ; 
dll 

2.  For  2  <  i  £  m: 

fil(xil>x0l)  =  max  (rii(x-ii*dii)  +  fi_i>i(tfi(x1-i,dii)  ,xqi  ) ) ; 
dil 

3.  Store  fml(xml»x0l)  for  later  use. 

B.  Stages  1  through  s-1: 

i*  fo(xo)  =  0 * 

2.  For  1  _<  i  <.  s-1: 

f  i  (x-j )  =  maxlriCxi.di)  +  fi-i  (t,  (xi  .d, ) ) ) ; 
di 

store  the  optimal  decision  dj*; 

3.  Store  ^s-l (xs_i ) ; 

C.  At  junction  s: 

fs(xs»x0l)  =  max(rs(xs,ds)  +  fs_i(ts(xs,ds) )  +  fml(tsi(xs.ds) ,xoi))) ; 
ds 

D.  Stages  s+1  through  j-1: 

fi(xi»x0l)  *  roax(n  (xi  ,dj )  +  f  i-l  (tj  (x,  .d^ )  ,xqi  ) ) ; 
di 

E.  Junction  j: 

fj(xj)  =  max(rj(xj,xoi,dj)  +  fj-i(tj(xj,xoi.dj) ,xqi)); 
dj»x01 

Store  dj*  and  xqi*  for  later  use. 


F,  Stages  j+1  through  n: 


f  i  ( x-j )  =  max(ri(xi,di)  +  fi-i(ti(xi,di)); 


Store  the  optimal  decision  d-j*; 


G.  Find  the  optimal  return  fn(xn*): 
fn(xn*)  s  max  fn(xn)i 


H.  Optimal  decisions  for  stage  n  through  1: 

fs(xs)  =  max(rs(xs,ds)  +  fs-l(^s(xs»^s)  +  fml(t$i(xs,ds)  »x01*) ) » 

ds 

Store  the  optimal  decision  ds*; 

2.  For  s+1  _<  i  _<  j-1: 

f  i  (x-j )  =  max(ri(xi,di)  +  f  i-l  (t,  (xi  .di ) ) ) ; 

<*i 

Store  the  optimal  decision  d-j*; 

3.  For  i=n  down  to  j+1: 

Find  d^*; 

xi-i*  =  ti(x,*,di*); 

4.  Find  dj*; 

xj-l*  a  tj(xj*,x01*,dj*); 

5.  For  i  =  j-1  dowh  to  1:  *' 

Find  di*; 

xi-l*  =  ti(xi*,di*); 

If  i  =  s+1  then  XS  =  xs*  and  DS  =  ds*. 

I.  For  optimal  decisions,  stages  mj  through  11: 

!•  ^ll(xll)  =  n’3x(rn(xii,d11):tn(x11,d11)  *  x0i*) ; 
dll 

Store  the  optimal  decision  d^*; 


2.  For  2  ^  i  £  m: 

fil(xn)  =  max(rii(xil,dii)  +  fi-i,i(tu(xii,dfi))); 

<*11 

Store  dii*; 

3.  Find  xmi*  =  tsl(xs,ds); 

4.  For  i=m  down  to  1: 

Find  dmi*; 

xi-l,l*  =  1 ; 

5.2  Feedback  Loop  Computer  Algorithm  (FBLCA) 

The  storage  requirements  for  FBLCA  are  tables  F(0:l,l:k), 
Fl(0:l,l:k,l:k)  for  optimal  returns  and  FS(l:k)  and  FM(l:k,l:k)  for 
storage  of  fs-l(xs_i)  and  Tml (xml >x0l)  'for  later  use.  The  notation  and 
techniques  used  here  are  the  same  as  in  section  2. 

A.  (*  stages  11  through  *) 

1.  (*  Initialize  FI ( 1 ,. ,. )  by  processing  stage  11  *) 

For  xn=l  to  kn  do 

For  XQpl  to  koi  do 

FI  (1  .Xu  ,xqi  )  =  riCxii.dn*)  =  max(rii(xu,dn):tii(xii,dii)  =  xqi); 

*  V  1  i  dU  <  PH 

2.  For  i=2  to  m  do 
st  =  (i-1)  mod  2; 
dt  =  i  mod  2; 

For  Xu  to  kji  do 

For  xqi=1  to  kii  do 

Fl(dt.Xii.xoi)  =  ni(xu,dii)  +  Fl(st,tii(xii,dii*),xoi)); 

=  max(rii(xii,d1i)  +  Fl(st,tii(xii.dii),xoi)); 

1  <  dil  <  Pil 


3.  (*  store  the  mth  stage  results  into  FM(.,.)  *) 

For  xm=l  to  kmi  do 

For  xoi=l  to  koi  do 
FM(xmi.xoi)  =  Fl(dt,x,i,xoi); 

B.  (*  stages  1  through  s-1  *) 

1.  (*  Initialize  by  putting  0's  in  the  source  table  *) 

For  i=l  to  k  do 
F(0,i)  =  0 

2.  For  i=l  to  s-1  do 

st  =  i  mod  2; 
dt  =  i  mod  2; 

For  Xj=l  to  k-j  do 

F{dt,xj)  =  ri(xi,dj*)  +  F(st,t, (xj .dj ) ) ; 

=  max(ri(xi,di)  +  F(st,tf(xf(df))); 

1  <  di  £  Pi 

tiUi.di*)  =  t-j  (xi*,di*)  +  kd; 

3.  For  xs_i=l  to  ks_i  do 

FS(xs_i)  =  F(dt,xs_i); 

C.  (*  Process  s  *) 

*  :  t 1 

st  =  (s-1)  mod  2; 
dt  =  s  mod  2; 

For  xs=l  to  ks  do 

For  xoi=l  to  kgi  do 

Fl(dt,xs,xoi)  =  rs(xs,ds*)  +  FS(ts(xs,ds*)  +  FM(tsl(xs,ds*),x0i) ; 

=  max(rs(xs,ds)  +  FS( ts (xs ,ds ) )  +  FM(tsl(xs,ds)xoi)) ; 
1  £  ds  <  Ps 


D.  (*  stages  s+1  to  j-1  *) 

For  i  =  s+1  to  j-1  do 
st  =  (i-1)  mod  2; 
dt  =  i  mod  2; 

For  Xj=l  to  do 

For  xqi=1  to  kgi  do 

Fl(dt,xi,x0i)  =  rj(xj,di*)  +  Fl(st,tj (x, ,di*),xoi) 

=  max(r-j (x-j  ,d-j )  +  Fl(st,ti(xi,dj),xoi)); 
1  1  di  <  Pi 

E.  (*  stage  j  *) 

St  =  (j-1)  mod  2; 
dt  =  j  mod  2; 

For  Xj=l  to  kj  do 

F(dt,Xj)  =  rj(xj,x01,d-j)  +  Fl(st,tj(xjJx0i  ,dj)  ,x0i)) ; 

*  max(r-j(xj ,xg£,dj)  +  Fl(st,tj(Xj,xoi,dj),xgi)); 

1  <  dj  <  Pj 

1  £  X01  <.  ^01 

tj(xj,x0l*,dj*)  =  tj(Xj,x0i*,dj)  +  kd; 

F.  (*  stages  j+1  through  n  *) 

For  i  =  j+1  through  n  do  v 

F(dt,Xj )  =  r, (xt ,df *)  +  F(st,t, (xj td* ) ) 

=  max(ri(xi,di)  +  F(st,ti(xt,di))); 

1  <  d,  <  Pi 

ti(xi,di*)  =  ti(xi,di*)  +  kd; 

G.  (*  Find  optimal  return  Fn(xn*)  *) 

F n  s  F(dt,xn*)  =  max  F(dtfx^)j 
1  1  xn  1 


H.  (*  optimal  decisions  from  n  through  1  *) 

1.  dt  =  s  mod  2; 

For  xs=l  to  ks  do 

F (dt ,xs)  =  rs(xs,ds*)  +  FS;ts(xs,ds*))  +  FM(tsi(xs,ds*) ,x0i*) 

=  max(rs(xs,ds)  +  FS(ts(xs,ds)  +  FM(tsi (xs,ds) ,xqi*) ) ; 
1  <  ds  <  Ps 

ts(xs>c*s*)  =  ts(xs»ds*)  +  kd» 

2.  For  i=s+l  to  j-1  do 
st  3  (i-1)  mod  2; 
dt  =  i  mod  2 ; 

For  x-j=l  to  k-j  do 

F(dt,xj)  =  ri(xi,di*)  +  F(st,tj (xj ,dj*)) 

=  max(r j (x, ,dj )  +  F(st,t-j  (x-j  ,d-j )) ) ; 

1  <  dj  <  Pj 

t-j (x-j  =  t-j(x-j,d-j*)  +  kgj 

3.  For  i=n  down  to  j+1  do 

Search  xj-row  of  tj  for  tj(xj*,dj*)  _>  kd,  1  <  di  <  Pi  i 
*i-l*  =  tj (xi*,dj*)  mod  kd; 

4.  Search  xj*-row  of  tj  for  tj (xj*,xoi*,dj*)  >  kd,  1  <  d j  £  P j  l 
Xj_i*  =  tj (xj*,xgi*,dj*)  mod  kd; 

5.  For  i  =  j-1  down  to  1  da* 

Search  Xi*-row  of  tj  for  tj(xj*,dj*)  >  kd,  1  <  dj  <  pi ; 

x-j _i *  =  t-j  (xj*,dj*)  mod  kd; 

If  i  =  s+1  then  XS  =  xs*  and  DS  =  ds*; 

I.  (*  Optimal  returns,  stages  through  11  *) 

1.  For  xn=l  to  k 1 1  do 

F(  1  »xll )  =  rll(xil  >dll*5  =  max(rii(xii,d1i):tn(xii,dii)  =  xqi*); 

1  <  dll  <  Pll 

tll(xll»dll*)  =  tll(xll>dll*)  +  kd* 


2.  For  i=2  to  m  do 


st  =  (i-1)  mod  2; 
dt  =  i  mod  2; 

For  x-j i=l  to  k-ji  do 

F(dt.x-ji)  =  Hitxii.dn*)  +  F(st,tii(xu,dii*) 

=  maxlri^xii.di!)  +  F(st ,t, i (x, i ,di ! ) ) ) ; 

1  <  <Ml  <  Pi  1 

til(xil»dil*)  *  tn(xii,dii*)  +  kd; 

3*-  xmi*  =  tg^XSjDS) 

4.  For  i=m  down  to  1  do 

Search  Xji*-row  of  tmi  for  tmi (x-ii*,d^i*)  kd 
For  1  <  dn  <  pU; 
xi-1,1  =  tii(xii*,dii*)  mod  kd; 

5. 3  Storage  Complexity  of  FBLCA 

All  notations  and  techniques  of  section  2  are  used. 

Theorem  7:  The  storage  complexity  of  FBLCA  is  given  by  2k2  +  2k  or  0(k2). 

Proof:  Fl(0:l,l:k,l:k)  are  used  to  process  the  branch  and  after  storing 

the  optimal  return  at  m-th  stage  in  FM(l:k,l:k)  both  these  tables  can 

.  •> 

be  released.  Then  F(0:l,l:k)  are  used  to  process  main  branch,  and 
FS(l:k)  for  storage  at  stage  for  later  use.  So  at  any  one  time  no  more 
than  2k2  +  k  storage  spaces  are  used. 

5.4  Computational  Complexity  of  FBLCA 


We  use  the  notations  and  techniques  of  section  2. 


Theorem  8:  The  computational  complexity  of  FBLCA  is  given  by 


m  s 

(4k -j i k.Q i Pi i  +  4kiip-ii  -  k^koi  +  +  p*i  +  12)  +  (4k i kojp,  -  k, kgi  +  5) 

i=l  i=j 


n 

+  (4ki pi  +  ki  +  Pi  +  7)  +  kspskoi  -  4k j p j  +  ksps  +  kjkoi  +  kmlkoi  +  k  +  k 
i=l 

+  3kn  +  l/2(3j2  -  3j  -  34) 


Proof:  Number  of  computations  at  each  step  is  listed  below. 


Step 
A.  1 

A.  2 

A.  3 

B.  1 

B.  2 

B.3 

C 

D 

E 

F 

G 

H.l 

H.2 


Number  of  Computations 


4kllk0lPll  -  kllk01 


m 

(4k i i koiPi 1  -  k flk01  +  5) 
i=2 


kmlk01 

k 


s-1 

(4kiPi  +  ki  +  5) 
i  =1 


k$-l 

( 5k ik0lPi  -  kikoi  +  5) 
j-1 

( 4k i koi Pi  -  kikoi  +  5) 

l=s+l 


4k jkoipj  +  kj  +  5 


(4kiPi  +  k,  +  5) 

i=j+l 
3kn  -  1 

5ksPs  +  ks  +  2 
j"l 

( 4k i Pi  +  ki  +  5) 

i=s+l 


» 


n 


I 


H.  3 

(Pi  +  2) 

i=j+l 

H.4 

Pj  +  2 

H.  5 

j-1 

(Pi  +  5) 
i=l 

1.1 

4knpn  +  kxl 

1.2 

m 

(4k i i Pi l  +  kii  +  5) 
i=2 

1.3,4 

m 

( Pi 1  +  2)  +  2 
i=l 

Addition  of  these  results  gives  the  formula  of  the  theorem. 

Corollary  11:  Suppose  the  discretization  level  of  all  state  and  decision 
variables  are  the  same  i.e,  k,x  =  Pil  =  M  Pi  =  k  for 
admissable  values  of  i.  Then  the  formula  for  complexity 
becomes 

(2m2  +  2j2  -  252  +  2m  +  2j  +  2$  +  l)k3  +  1/2 (3m2  +  4n2  +  s2  -  j2  +  3m  +  4n 
-  j  -  s  -  2)k2  +  (m2  +  n2  +  m  +  n  +  5)k  +  l/2(12m2  +  7n2  +  8j2  -  5s 

+  2j  -  34) 

Corollary  12:  The  computational  complexity  of  FBLCA  can  be  described  as 
0(k3) ,  0(m2) ,  0 ( n2 ) . 

Corollary  13:  Suppose  that  all  three  subbranches  in  feedback  loop  system 
are  of  approximately  equal  lengths,  i.e,  s  =  j/2  =  n/3.  Then  computational 
complexity  formula  reduces  to 

(8m2  +  8m  +  l)k2  +  (18m2  +  6m  -  l)k2  +  (10m2  +  4m  +  7)k  +  (51m2  +  21m 

-  18)  . 

Thus  this  complexity  has  representations  0(k3)  and  0(m2). 


I 

I 


Corollary  14:  The  computational  complexity  depends  on  junction  points 
of  the  loop.  More  specifically  it  is  0(j2  -  s2)  in  terms  of  junction 
parameters. 

6.  Comparison  and  Analysis  of  Complexities 

6.1  Analysis  of  Storage  Complexities 

We  list  the  results  from  various  network  systems  below  in  terms  of 
parameter  k  where  k  is  the  level  of  discretization  of  state  and  decision 
variables. 


System 

Complexity 

Depends  on  Junctions 

Diverging  Branch 

0(k) 

NO 

Converging  Branch 

0(k2) 

NO 

Feedforward  Loop 

0(k2) 

NO 

Feedback  Loop 

0(k2) 

NO 

6.2  Analysis  of  Computational  Complexities 

Results  of  various  systems  are  listed  below  in  terms  of  discreti¬ 
zation  level  k,  lengths  of  branch  and  main  branch,  and  dependence  on 
junctions  points. 


Parameter 

k 

m 

n 

Junction  Points  j  and  s 

Converging  Branch 

0(kl) 

O(mfL) 

0(ni) 

Diverging  Branch 

0(kl) 

0(m2) 

0(ni) 

Feedforward  Loop 

0(ki) 

0(ni.) 

0(n£) 

0(jl  -  si) 

Feedback  Loop 

0(kl) 

_0(ni) 

_0(n2j_ 

_ 0JL£  -  4) _ 

